Skip to content

Conversation

@hubertlu-tw
Copy link

FusedRMSNorm PR: #78
The failed unit tests which were skipped in this PR: #78 (comment)

eqy and others added 9 commits April 14, 2022 23:15
* FusedRMSNorm based on FusedLayerNorm

* refactor duplicated kernels

* delete comments

* delete comments

* cleanup

* cleanup

* cleanup, fixed clobbering forward_affine_mixed_dtypes

* fix pybind naming and add MixedFused test

* undo skipping

* check elementwise_affine

* Update tests/L0/run_fused_layer_norm/test_fused_layer_norm.py

Oof, nice catch, thanks

Co-authored-by: Masaki Kozuki <masaki.kozuki.2014@gmail.com>

Co-authored-by: Masaki Kozuki <masaki.kozuki.2014@gmail.com>
* [FusedRMSNorm doc] add epsilon to formula

* correct

* better wording
@hubertlu-tw hubertlu-tw force-pushed the dev/hubertlu/FusedRMSNorm_skipped_tests branch from b41548c to 59e8df4 Compare August 5, 2022 21:32
@hubertlu-tw hubertlu-tw closed this Aug 5, 2022
@hubertlu-tw hubertlu-tw deleted the dev/hubertlu/FusedRMSNorm_skipped_tests branch August 5, 2022 21:41
@hubertlu-tw hubertlu-tw removed the request for review from jithunnair-amd August 5, 2022 21:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants